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For the single-server queue with renewal input, we obtain heavy traffic 
approximations for the time-dependent distributions of queue length and 
virtual delay by constructing approximating diffusion processes. These 
approximations are shown to agree with known limiting cases, and a com- 
parison is made with results from a computer simulation. 

I. INTRODUCTION 

We consider a single-server queuing system where the interarrival 
times are independent and identically distributed (i.i.d.) random 
variables, customers are served in order of arrival, the service times 
of the various customers are i.i.d. random variables, and the inter- 
arrival and service times form independent sequences. Lindley 1 ob- 
tained a recursive equation for the delay-time of the nth arriving cus- 
tomer, an integral equation for the delay time of a customer in the 
steady-state, and conditions for the latter to have a nondegenerate 
limit. 

Lindley's equations have not yielded to conveniently used analytical 
solutions, except in some special cases, stimulating a search for ap- 
proximations to the distributions of general interest. In this paper, we 
approximate the queue length and delay processes by appropriately 
chosen diffusion processes. This method of approximation appears to 
have been introduced by Gaver 2 and Newell. 3 Gaver and Newell con- 
sidered the m/g/i queue; we extend their approximate models to the 
gi/g/i queue. Other methods for obtaining diffusion approximations 
for queuing processes involve applying the theory of weak convergence 
to sequences of approximating processes. Whitt 4 is a survey of these 
methods and contains an extensive bibliography. We show that the 
diffusion models developed in this paper agree with the limiting 
processes obtained by weak convergence methods. 

Important features of this paper are the use of the m/m/i queue to 
motivate a diffusion process approximation for the single-server queue 
and the use of elementary renewal theory results to obtain the param- 
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eters of the process. This approach provides an intuitive explanation 
for the limit theorems. 

II. PRELIMINARIES AND NOTATION 

Let Ti be time between the arrival epochs of the (i — l)st and ith 
customers, i= 1,2, •••, assume these random variables are i.i.d., 
and let X -1 = E(Ti) and a\ = Var (Ti). Assume the customers are 
served in order of arrival, let Si be the service time of the ith. customer, 
n~ l = E(Si), a% = Var (Si), and assume Si, S2, ■ ■ • are i.i.d. random 
variables. We define the traffic intensity by p = X//i and will always 
assume p < 1. We seek approximations for the queue size and virtual 
delay at time t, and obtain these approximations from suitably chosen 
diffusion processes. For any function F, let F x = dF/dx, F xx = d 2 F/ 
dx 2 , F v = dF/dy, etc., and unambiguous arguments will be suppressed. 

Let \X(t), t ^ 0} be a homogeneous and additive diffusion process, 
F(t, x; x ) = Pr {X(t) ^ x\X(0) = x \, and a and b be the infinitesi- 
mal mean and variance of the process, respectively. Then F satisfies 
the forward Kolmogorov (Fokker-Planck) equation 

F t = -aF x + \F xx , (1) 

with initial condition 

[0 if x < x , 2 v 



F(0,«;«J- , jf xiXo 



If the range of X(t) is [0, «), then (1) is subject to the boundary 
condition 

F(t,0;x ) = 0, t >0. (3) 

The solution to (1) subject to (2) and (3) is given in Newell 6 as 
^.) = *(*^)-^(^fp*),(4) 



where 



-far /-co 



is the normal distribution function (d.f.). If a < 0, then 

F(x) = lim F(x, t;x ) = 1 - r*»<— >'», (5) 



t-ao 



which is the negative-exponential d.f. and is independent of x . 

Returning to the gi/g/i queue, let Wi denote the delay of the ith 
customer. Lindley showed that when p < 1, W = lim.^^ Wi is non- 
degenerate. Kingman 6 showed that if p is slightly less than unity, the 
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d.f. of W is approximately negative-exponential with mean 

*(eri + oi)/(X-» - M" 1 ). (6) 

III. AN APPROXIMATION FOR THE M/M/1 QUEUE 

To motivate the diffusion model employed in approximating the 
gi/g/1 queue, and to indicate its efficacy for the m/m/ l queue in par- 
ticular, we first develop an approximation for the m/m/i queue. A 
scheme suggested by Bailey 7 for approximating stochastic processes is 
used. 

In the m/m/i queue, customers arrive according to a Poisson process 
with rate X, and the service-time distribution is negative-exponential 
with mean /x~ l . Let N(t) denote the number of customers in the queue 
at time t, and ir(t, n;n ) = Pr [N(t) = n\N(0) = n }. For t > and 
n = 1, 2, • • •, ir(t, n; n ) satisfies 

■j ir{t, n; n ) = Xtt(J, n — 1 ; n ) + nir(t, n + 1 ; n ) 

— (X + n)r(t, n;n ), (7a) 

and 

~r ir{t, 0; n ) = nir{t, 1 ; n ) — \ir(t, 0; n ). (7b) 



The initial condition is 

tn x 1 if n = n 

7r(0, n; no) 



(8) 



if w^rio 
and the boundary condition is 

•(*,n;n ) = n < 0, t ^ 0. (9) 



7T ( 



The idea of the approximation is to replace (7) by a partial differ- 
ential equation that is easier to solve. We do this by replacing the dis- 
crete variable n by the continuous variable x, and ir{t, n;n ) by 
p(t, x;x ) in (7). Expanding in a Taylor's series about the point 
{t, x ; x ) and keeping only first- and second-order terms, we obtain 



Pt = - (X - n) Px + ^4^ Pxx , x,t>0. (10) 



If we define 



P(t, x;x ) = J p(t,y;x )dy, 
it can be easily shown that P also satisfies (10). We take 
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and 

P(*,0;z ) = 0, t > 0, (12) 

as natural replacements for (8) and (9). This system of equations is 
identical in form to (1), (2), and (3), so P(t, x; x Q ) is given by the right- 
side of (4) with a = X — n and b = X + /i. 

Consider now the asymptotic behavior of t and P : From the theory 
of the m/m/i queue, we have 

7T„ = lim ir(t, n; n ) = (1 — p)p n ~ 1 for n > 

and from (5) we obtain 

P(0 = lim F(t, x; x ) = 1 - exp [-2(1 - p)/(l + p)J 

t-»ao 

If for n > we approximate ir n by 

# n = r dv{t), 

Jn-l 

we obtain 

ir n = [l — e -2a-p)/a+p)] e - 2 (»- 1 )( 1 -p)/(i+p) 

= (1 - a)a n -\ n > 0, 

where a = exp [—2(1 — p)/(l + p)J, so T n has the same form as ir„. 
If p is close to unity, a = p and hence 

irn = ir», p = 1, 

so 7T„ is a good approximation of t„ when p is slightly less than one. 

IV. THE GI/G/1 QUEUE— APPROXIMATE QUEUE LENGTH 

Let us first consider a heuristic manner of obtaining (10) for the 
m/m/i queue. During the time interval {t, t + AQ, the number of 
customers in the system changes by the number of arrivals minus the 
number of service completions, and when N(t) = n > 0, this change 
has expectation (X — p,)At + o(At) and variance (X + p)At + o(At). 
To approximate {N(t), t ^ 0} by a diffusion process with the same 
infinitesimal mean and variance, set a = X — p. and b = X + p in (1), 
which yields (10). This suggests that an appropriate choice of a and b 
will yield a good approximation for the queue length of the gi/g/i 
queue. 

For the gi/g/ l queue, let N (t) be the queue size at time t, A (t) and 
D (t) the number of arrivals and departures in (0, Q, respectively ; then 

N(t) = N(0) + A(t) - D(t), t > 0. (13) 
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For any renewal process [M(t), t ^ 0} where the interevent times 
have mean m and variance V, for large values of t 

E[_M{t)~] « t/m, (14) 

and 

Var ZM(t)ltttV/m 3 , (15) 

(Ref. 8). By hypothesis [A(t), t ^ 0} is a renewal process, so from 
(14) and (15) we obtain 

E[A (0] » M, Var [A (<)] « XV 2 A *. (16) 

The process [D(t), t ^ 0} is not a renewal process, but, in heavy 
traffic (p close to 1), the server will be occupied most of the time, so 
we approximate D(t) by D(t), where 

ElD(t)~]tt>it, Var [5(0] «/*'<#• (17) 

Cox and Smith 9 use (13), (16), and (17) to study the gi/g/i queue 
for small values of t without using a diffusion model. Substituting 
D(t) for D(t) in (13) and using (16) and (17), we obtain the approxi- 
mate results 

lim ElN(t)2/t = X - m ( 18 ) 

| -.00 

and 

lim Var [JV (*)]/< = XM + A 2 *, (19) 

(-.00 

which suggest that we approximate N(t) by a diffusion process N(t), 
say, with infinitesimal mean and variance given by 

a = X - M (20) 

and 

6 - \»oi + m 3 <4, (21) 

respectively. If we let F(t,x;x ) = Yr [ft(t) g x\ft(0) = x \, then 
i* 7 satisfies (1), (2), (3), and hence is given by (4), with a and b as above. 
As a partial check on the efficacy of this approximation, let us define 
fit = limj-^ N(t). For p < 1, fit is a proper random variable, and from 
(5), (20), and (21), 

which together with the queuing formula L = \W (see Ref. 10) and 
p = 1 yields the heavy traffic approximation given by (6). 

V. THE GI/G/1 QUEUE— APPROXIMATE VIRTUAL DELAY 

The virtual delay at time t is the delay in queue a customer would 
experience if it arrived at time t; an exact formulation is given by 
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BeneS. 11 Toward developing an approximation of the virtual-delay 
process, define 

L(t) = St + S 2 + • • • + Sam, t > 0, (23) 

so L(t) represents the amount of work time brought to the server in 
(0, t]. Since Si, S 2 , • • • , Sam are i.i.d., using (17) we obtain 

E[L{t)] = E{S X )E[A (t)] « pt (24) 

for large values of t. Using the conditional variance relationship 
Var [L(0] = E{Y&r ZL(t)\A(t)]} + Var [EZL(t)\A(t)]} and (17), 
we obtain for large values of t, 

Var [L(0] « \(a% + p 2 <£)«. (25) 

The sample paths of the virtual delay process are sawtooth functions 
with a jump of size Si at the arrival epoch of the ith customer followed 
by a decline of slope — 1 ; the process has an impenetrable boundary 
at the axis of abscissas. Assume that (24) and (25) hold for all t, so that 



a = lim [E{L{t + At)] - E[L{t)])/At = p (26) 



A*-*0 



and 



= lim {Var [L(t + At)] - Var [_L{t)]\/At 

At-»0 

- X(«r| + pVO. (27) 

Following Gaver, 2 we approximate the virtual-delay process by a 
diffusion process [V(t), t ^ 0}, say, with infinitesimal mean and 
variance given by 

a = p - 1, b = \(c% + P V A ), (28) 

respectively. Hence, the time-dependent d.f. of v(t) is given by (4) 
with a and b given by (28). 

Turning now to asymptotic results, when p < 1, V = limj^ flo y(f) 

exits and is proper, and from (5) has a negative-exponential distribution 
with mean 

E(V) = \{a% + pViVOr 1 - M" 1 ). (29) 

Hooke 12 showed that, if the interarrival times are nonlattice, then 
as p 1 1, Pr [W ^ *} — *Pr \V ^ a;}, where 7 is the virtual delay in 
the steady state. This result and (29) together show that, as p f 1, 
E(V)/E(W) t 1, and the d.f. of V agrees with (6). From (22) and (29) 
we observe that E(V) < E(ft)/p when p < 1, but E(V) £ E(N)/n 
is known to hold. 
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We note that once a diffusion model for the virtual-delay process 
is at hand, the method given in Heyman 13 for approximating the busy- 
period distribution can be applied. 

VI. A NUMERICAL EXAMPLE 

In this section, we compare E[N(t)2 to the results of a single com- 
puter simulation. We consider a single-server queue that is empty at 
time zero, where the interarrival times are uniformly distributed from 
to 20 minutes, and the service times are uniformly distributed from 
to 19 minutes. Thus, 

X- 1 = 10, a\ = 100/3, ix- 1 = 9.5, a% = (9.5) 2 /3 ; (30) 

hence, p = 0.95 and from (22) we obtain E(fi?) = 6.50. Since the d.f. 
of ft is negative-exponential, the standard deviation of N is also 6.50. 
Let Nj(t) denote the sample of N(t) produced by the jih simula- 
tion run, Nj be the estimate of N produced by the jth run, and 
N = n~ l 5Iy=iiVj. Assuming the simulator produces independent 
sample paths and approximating the mean and variance of N by those 
of ft, standard sampling theory indicates that, for reasonably large 
values of n, N has a normal distribution with mean 6.5 and standard 
deviation 6.5/Vn. Hence, given c > 0, the number of runs required to 
have 

Pr { \ff - E(N)\ g cE(N)} ^ 0.99 

is the smallest integer ^ (2.575) 2 /c; choosing c = 0.05 yields n = 134. 

These considerations lead us to simulate 150 sample paths, and indi- 
cate one of the potential uses of even a crude diffusion approximation. 

Gaver 2 and Newell 5 observe that if one makes the change of vari- 
ables £ = — (a/b)x and t = (a 2 /6)/, (1) becomes 

F T = -Ft + Fa/2, (31) 

which can be solved once and for all ; the solutions for any a and b can 
be recovered by scaling. For our example, — (b/a) = 13.00 and b/a? 
= 2472.2 minutes. Table 2-2 in Gaver 2 gives the values of 



j™ itd,:F(T, £;0) 



for r = 0.1, 0.2, • • •, 1.0. These were used to construct Table I below. 
The approximations shown in the table are not as accurate as the 
diffusion approximations for m.'g/i shown in Table I of Gaver 2 ; these 
comparisons share with Gaver's table the property that the diffusion 
process consistently overestimates the mean queue-size. 
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Table I — Comparison of diffusion approximation 
and simulation results 



Time 


T 


Eimn 


0.1 


0.2 


0.3 


0.4 


0.5 


0.6 


0.7 


0.8 


0.9 


1.0 


Diffusion 
Simulation 


2.68 
2.25 


3.50 
2.91 


4.02 
3.40 


4.40 
3.71 


4.68 
4.16 


4.91 
4.39 


5.11 
4.61 


5.27 
5.05 


5.41 
5.18 


5.52 
5.13 



VII. COMPARISON WITH THE RESULTS OF IGLEHART AND WHITT 

Iglehart and Whitt 14 ' 15 use the theory of weak convergence of 
stochastic processes to obtain heavy-traffic-limit theorems for large 
classes of queuing processes. In particular, these theorems hold for the 
gi/g/i queue. Their results are obtained by considering a sequence of 
gi/g/i queuing systems, indexed by n {n = 1, 2, • • •)• For the nth 
system, let X„ and /*„ denote the arrival and service rates, respectively, 
and N„(t) and V n {t) denote the queue size and virtual delay at time 
t, respectively. For the above quantities, let the absence of a subscript 
denote the limit with respect to n, e.g., X = lim n -ooX n . For eachn, let 
a 2 A and a% be as before, and assume N n (0) = V n (0) = 0. 

Section three of Iglehart and Whitt 14 shows that if 

lim n -.oo (X n — Mn)Vw = c, where c is some finite constant, then 



.. N n (nt') . n/4t i v 

hm — y^ =>-B(<, -c/y), 



(32) 



where y = \ z a\ + p'o% } B{t', —c/y) is the Wiener process with nega- 
tive drift c/y together with an impenetrable barrier at the origin and 
=> denotes weak convergence. From (32) it follows that for large 
values of n, i.e., when p n = X„/ju„ is close to I, 

Pr {N n (nt')/yT[n g d} 

Since N n (t) = N(t), c = (X — fi)yn for large n, upon making the 
change of variables x = dyvn and t = nt' , we obtain 



Pr {N(t) g x] 



± g/g- (X-M)*\ _ e 2(X-,)x/ r2$ / 



— x — (X — n)t 



) (34) 



from (33). Observe that the right-hand side of (34) agrees exactly with 



1644 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1975 



the time-dependent distribution (when x = 0) of N(t) obtained in 
Section IV. 

Let a n = Hn 1 — Xjj" 1 and a 2 = a\ + <4- From theorem 6.1 of 
Iglehart and Whitt, 15 it is possible to derive the following result, which 

appears in theorem 4 of Whitt. 16 If a n a~ l -\n — > —k, — oo < k < », 

then 

Vn{nt') 



<WftX n 



>£(*', -&). (35) 



For large values of n, a n — (p — 1)X -1 , —k= (p — l)X -1 o- _1 Vw, 
V.(0 = V(t), and 



Pr {7(0 ^ dWXn} 

* * ( " + v? ^ ) " e " 2 "^ ( ~ TT^) ■ (36) 

Letting t = nt' and x = d<r'4^n in (35), we obtain 
Pr{F(i) ^ a;} 

The right-hand side of (36) represents the time-dependent distribu- 
tion (4) with x = and 

a = p - 1, 6 = A(<ri + a%), (38) 

which is the same value of a and almost the same value of b given in 
(28), where the difference between the values of b given in (28) and 
(38) vanishes as p — > 1. 

From the results of this section, we can conclude that the heuristically 
constructed diffusion models for N(t) and V(t) given in this paper can 
be regarded as the limit (in the sense of weak convergence) of N(t) 
and V(t), respectively, with suitable normalization. 

VIII. SUMMARY 

We have obtained an approximation for the time-dependent dis- 
tributions of queue length and virtual delay in a gi/g/i queue using 
a diffusion model. The diffusion model for the queue length process 
was obtained by using the mean and variance of the asymptotic rate 
of change of an approximation of the queue-length process as the 
infinitesimal mean and variance for a diffusion process. The diffusion 
approximation was compared to a simulation of a particular queueing 
process, and reasonably close agreement for mean queue lengths was 
obtained. The approximation for the virtual-delay process was gen- 
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erated in a manner suggested in Gaver 2 and the limiting results it 
provided were shown to agree with a theorem of Kingman 6 for the 
delay process. The time-dependent distributions for the approximate 
queue length and virtual-delay processes agree, as the traffic intensity 
approaches one, with the limiting results of Iglehart and Whitt. 14,15 
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